Add graalvm25 image to testing #9562

sarahchen6 · 2025-09-18T14:38:57Z

What Does This Do

Add Graalvm 25 image testing to CI

Motivation

Additional Notes

The current failure has to do with JFR initialization.

Adding the -XX:StartFlightRecording=filename=${testJfrDir}/recording.jfr flag to the createProcessBuilder() method in the dd-smoke-tests/spring-boot-3.0-native/src/test/groovy/SpringBootNativeInstrumentationTest.groovy file resolves the issue, but this flag should not be necessary because we're using the Java API to start the recording.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-83

datadog-official · 2025-09-18T15:00:31Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 57.98% (-0.03%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: ca67bab | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-18T15:14:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1759341231	1759343182
git_commit_sha	`c096994`	`ca67bab`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~ca67bab57c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759344957	1759344957
ci_job_id	1158264243	1158264243
ci_pipeline_id	78117784	78117784
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-bsuefs4m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-bsuefs4m 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.013 s) : 0, 1012959
Total [baseline] (8.653 s) : 0, 8652608
Agent [candidate] (1.015 s) : 0, 1014637
Total [candidate] (8.688 s) : 0, 8687584
section iast
Agent [baseline] (1.151 s) : 0, 1151078
Total [baseline] (9.245 s) : 0, 9245331
Agent [candidate] (1.153 s) : 0, 1153277
Total [candidate] (9.265 s) : 0, 9264514

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.013 s	-
Agent	iast	1.151 s	138.119 ms (13.6%)
Total	tracing	8.653 s	-
Total	iast	9.245 s	592.723 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	iast	1.153 s	138.64 ms (13.7%)
Total	tracing	8.688 s	-
Total	iast	9.265 s	576.93 ms (6.6%)

gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (694.858 ms) : 0, 694858
BytebuddyAgent [candidate] (692.507 ms) : 0, 692507
GlobalTracer [baseline] (236.771 ms) : 0, 236771
GlobalTracer [candidate] (238.04 ms) : 0, 238040
AppSec [baseline] (32.731 ms) : 0, 32731
AppSec [candidate] (33.325 ms) : 0, 33325
Debugger [baseline] (6.37 ms) : 0, 6370
Debugger [candidate] (6.443 ms) : 0, 6443
Remote Config [baseline] (677.03 µs) : 0, 677
Remote Config [candidate] (706.096 µs) : 0, 706
Telemetry [baseline] (9.047 ms) : 0, 9047
Telemetry [candidate] (9.134 ms) : 0, 9134
Flare Poller [baseline] (9.658 ms) : 0, 9658
Flare Poller [candidate] (11.833 ms) : 0, 11833
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (819.336 ms) : 0, 819336
BytebuddyAgent [candidate] (819.62 ms) : 0, 819620
GlobalTracer [baseline] (228.13 ms) : 0, 228130
GlobalTracer [candidate] (229.399 ms) : 0, 229399
IAST [baseline] (26.513 ms) : 0, 26513
IAST [candidate] (26.723 ms) : 0, 26723
AppSec [baseline] (35.246 ms) : 0, 35246
AppSec [candidate] (35.322 ms) : 0, 35322
Debugger [baseline] (6.057 ms) : 0, 6057
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (587.351 µs) : 0, 587
Remote Config [candidate] (593.082 µs) : 0, 593
Telemetry [baseline] (8.236 ms) : 0, 8236
Telemetry [candidate] (8.352 ms) : 0, 8352
Flare Poller [baseline] (4.275 ms) : 0, 4275
Flare Poller [candidate] (4.337 ms) : 0, 4337

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.017 s) : 0, 1017486
Total [baseline] (9.693 s) : 0, 9693481
Agent [candidate] (1.016 s) : 0, 1016355
Total [candidate] (10.782 s) : 0, 10782352
section appsec
Agent [baseline] (1.196 s) : 0, 1196441
Total [baseline] (11.101 s) : 0, 11101196
Agent [candidate] (1.19 s) : 0, 1189733
Total [candidate] (11.086 s) : 0, 11085636
section iast
Agent [baseline] (1.148 s) : 0, 1147513
Total [baseline] (10.876 s) : 0, 10875714
Agent [candidate] (1.161 s) : 0, 1161171
Total [candidate] (11.179 s) : 0, 11178924
section profiling
Agent [baseline] (1.176 s) : 0, 1175691
Total [baseline] (11.177 s) : 0, 11176846
Agent [candidate] (1.156 s) : 0, 1155815
Total [candidate] (11.058 s) : 0, 11057540

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.017 s	-
Agent	appsec	1.196 s	178.955 ms (17.6%)
Agent	iast	1.148 s	130.027 ms (12.8%)
Agent	profiling	1.176 s	158.205 ms (15.5%)
Total	tracing	9.693 s	-
Total	appsec	11.101 s	1.408 s (14.5%)
Total	iast	10.876 s	1.182 s (12.2%)
Total	profiling	11.177 s	1.483 s (15.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.016 s	-
Agent	appsec	1.19 s	173.378 ms (17.1%)
Agent	iast	1.161 s	144.816 ms (14.2%)
Agent	profiling	1.156 s	139.46 ms (13.7%)
Total	tracing	10.782 s	-
Total	appsec	11.086 s	303.284 ms (2.8%)
Total	iast	11.179 s	396.572 ms (3.7%)
Total	profiling	11.058 s	275.188 ms (2.6%)

gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.46 ms) : 0, 1460
BytebuddyAgent [baseline] (696.592 ms) : 0, 696592
BytebuddyAgent [candidate] (693.881 ms) : 0, 693881
GlobalTracer [baseline] (238.928 ms) : 0, 238928
GlobalTracer [candidate] (238.982 ms) : 0, 238982
AppSec [baseline] (33.129 ms) : 0, 33129
AppSec [candidate] (33.151 ms) : 0, 33151
Debugger [baseline] (6.506 ms) : 0, 6506
Debugger [candidate] (6.492 ms) : 0, 6492
Remote Config [baseline] (695.639 µs) : 0, 696
Remote Config [candidate] (702.601 µs) : 0, 703
Telemetry [baseline] (9.114 ms) : 0, 9114
Telemetry [candidate] (9.136 ms) : 0, 9136
Flare Poller [baseline] (9.596 ms) : 0, 9596
Flare Poller [candidate] (11.184 ms) : 0, 11184
section appsec
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (720.904 ms) : 0, 720904
BytebuddyAgent [candidate] (716.861 ms) : 0, 716861
GlobalTracer [baseline] (231.959 ms) : 0, 231959
GlobalTracer [candidate] (230.22 ms) : 0, 230220
AppSec [baseline] (175.527 ms) : 0, 175527
AppSec [candidate] (174.895 ms) : 0, 174895
Debugger [baseline] (6.135 ms) : 0, 6135
Debugger [candidate] (6.124 ms) : 0, 6124
Remote Config [baseline] (659.954 µs) : 0, 660
Remote Config [candidate] (646.765 µs) : 0, 647
Telemetry [baseline] (9.161 ms) : 0, 9161
Telemetry [candidate] (9.091 ms) : 0, 9091
Flare Poller [baseline] (4.017 ms) : 0, 4017
Flare Poller [candidate] (3.982 ms) : 0, 3982
IAST [baseline] (25.376 ms) : 0, 25376
IAST [candidate] (25.269 ms) : 0, 25269
section iast
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.479 ms) : 0, 1479
BytebuddyAgent [baseline] (815.234 ms) : 0, 815234
BytebuddyAgent [candidate] (824.68 ms) : 0, 824680
GlobalTracer [baseline] (227.999 ms) : 0, 227999
GlobalTracer [candidate] (230.967 ms) : 0, 230967
AppSec [baseline] (35.547 ms) : 0, 35547
AppSec [candidate] (35.82 ms) : 0, 35820
Debugger [baseline] (6.08 ms) : 0, 6080
Debugger [candidate] (6.217 ms) : 0, 6217
Remote Config [baseline] (599.614 µs) : 0, 600
Remote Config [candidate] (600.21 µs) : 0, 600
Telemetry [baseline] (8.223 ms) : 0, 8223
Telemetry [candidate] (8.443 ms) : 0, 8443
Flare Poller [baseline] (4.336 ms) : 0, 4336
Flare Poller [candidate] (4.264 ms) : 0, 4264
IAST [baseline] (26.816 ms) : 0, 26816
IAST [candidate] (27.259 ms) : 0, 27259
section profiling
ProfilingAgent [baseline] (105.586 ms) : 0, 105586
ProfilingAgent [candidate] (103.431 ms) : 0, 103431
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.455 ms) : 0, 1455
BytebuddyAgent [baseline] (733.022 ms) : 0, 733022
BytebuddyAgent [candidate] (721.071 ms) : 0, 721071
GlobalTracer [baseline] (217.412 ms) : 0, 217412
GlobalTracer [candidate] (214.206 ms) : 0, 214206
AppSec [baseline] (33.248 ms) : 0, 33248
AppSec [candidate] (32.589 ms) : 0, 32589
Debugger [baseline] (8.234 ms) : 0, 8234
Debugger [candidate] (6.514 ms) : 0, 6514
Remote Config [baseline] (778.17 µs) : 0, 778
Remote Config [candidate] (809.771 µs) : 0, 810
Telemetry [baseline] (15.05 ms) : 0, 15050
Telemetry [candidate] (16.515 ms) : 0, 16515
Flare Poller [baseline] (4.281 ms) : 0, 4281
Flare Poller [candidate] (4.182 ms) : 0, 4182
Profiling [baseline] (109.516 ms) : 0, 109516
Profiling [candidate] (106.628 ms) : 0, 106628

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1759341231	1759343182
git_commit_sha	`c096994`	`ca67bab`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~ca67bab57c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1759344664	1759344664
ci_job_id	1158264244	1158264244
ci_pipeline_id	78117784	78117784
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-1i1sbz2p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-1i1sbz2p 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+169.282µs; +418.834µs] or [+2.197%; +5.436%]	unstable [-83.465op/s; +76.209op/s] or [-14.319%; +13.074%]	7.998ms	579.281op/s	7.704ms	582.909op/s
scenario:load:insecure-bank:iast_FULL:high_load	worse [+546.135µs; +1163.495µs] or [+3.895%; +8.298%]	unstable [-54.867op/s; +16.992op/s] or [-16.514%; +5.114%]	14.876ms	313.312op/s	14.021ms	332.250op/s
scenario:load:petclinic:appsec:high_load	better [-2.993ms; -2.039ms] or [-5.893%; -4.014%]	unstable [-2.193op/s; +11.643op/s] or [-2.378%; +12.624%]	48.278ms	96.950op/s	50.794ms	92.225op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.364 ms) : 4315, 4413
.   : milestone, 4364,
iast (9.943 ms) : 9778, 10107
.   : milestone, 9943,
iast_FULL (14.021 ms) : 13740, 14303
.   : milestone, 14021,
iast_GLOBAL (10.972 ms) : 10774, 11170
.   : milestone, 10972,
profiling (8.409 ms) : 8279, 8539
.   : milestone, 8409,
tracing (7.704 ms) : 7597, 7812
.   : milestone, 7704,
section candidate
no_agent (4.471 ms) : 4421, 4522
.   : milestone, 4471,
iast (9.66 ms) : 9497, 9822
.   : milestone, 9660,
iast_FULL (14.876 ms) : 14584, 15169
.   : milestone, 14876,
iast_GLOBAL (10.596 ms) : 10410, 10781
.   : milestone, 10596,
profiling (8.694 ms) : 8559, 8829
.   : milestone, 8694,
tracing (7.998 ms) : 7874, 8122
.   : milestone, 7998,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.364 ms [4.315 ms, 4.413 ms]	-
iast	9.943 ms [9.778 ms, 10.107 ms]	5.579 ms (127.8%)
iast_FULL	14.021 ms [13.74 ms, 14.303 ms]	9.658 ms (221.3%)
iast_GLOBAL	10.972 ms [10.774 ms, 11.17 ms]	6.608 ms (151.4%)
profiling	8.409 ms [8.279 ms, 8.539 ms]	4.045 ms (92.7%)
tracing	7.704 ms [7.597 ms, 7.812 ms]	3.34 ms (76.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.471 ms [4.421 ms, 4.522 ms]	-
iast	9.66 ms [9.497 ms, 9.822 ms]	5.188 ms (116.0%)
iast_FULL	14.876 ms [14.584 ms, 15.169 ms]	10.405 ms (232.7%)
iast_GLOBAL	10.596 ms [10.41 ms, 10.781 ms]	6.124 ms (137.0%)
profiling	8.694 ms [8.559 ms, 8.829 ms]	4.223 ms (94.4%)
tracing	7.998 ms [7.874 ms, 8.122 ms]	3.527 ms (78.9%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.217 ms) : 36920, 37515
.   : milestone, 37217,
appsec (50.794 ms) : 50341, 51247
.   : milestone, 50794,
code_origins (43.764 ms) : 43394, 44134
.   : milestone, 43764,
iast (45.255 ms) : 44873, 45636
.   : milestone, 45255,
profiling (48.088 ms) : 47643, 48534
.   : milestone, 48088,
tracing (45.329 ms) : 44933, 45724
.   : milestone, 45329,
section candidate
no_agent (37.101 ms) : 36808, 37394
.   : milestone, 37101,
appsec (48.278 ms) : 47845, 48712
.   : milestone, 48278,
code_origins (44.037 ms) : 43658, 44415
.   : milestone, 44037,
iast (44.367 ms) : 43983, 44751
.   : milestone, 44367,
profiling (49.423 ms) : 48912, 49934
.   : milestone, 49423,
tracing (44.017 ms) : 43625, 44408
.   : milestone, 44017,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.217 ms [36.92 ms, 37.515 ms]	-
appsec	50.794 ms [50.341 ms, 51.247 ms]	13.577 ms (36.5%)
code_origins	43.764 ms [43.394 ms, 44.134 ms]	6.546 ms (17.6%)
iast	45.255 ms [44.873 ms, 45.636 ms]	8.037 ms (21.6%)
profiling	48.088 ms [47.643 ms, 48.534 ms]	10.871 ms (29.2%)
tracing	45.329 ms [44.933 ms, 45.724 ms]	8.111 ms (21.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.101 ms [36.808 ms, 37.394 ms]	-
appsec	48.278 ms [47.845 ms, 48.712 ms]	11.177 ms (30.1%)
code_origins	44.037 ms [43.658 ms, 44.415 ms]	6.936 ms (18.7%)
iast	44.367 ms [43.983 ms, 44.751 ms]	7.266 ms (19.6%)
profiling	49.423 ms [48.912 ms, 49.934 ms]	12.322 ms (33.2%)
tracing	44.017 ms [43.625 ms, 44.408 ms]	6.916 ms (18.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	sarahchen6/test-graalvm25
git_commit_date	1759341231	1759343182
git_commit_sha	`c096994`	`ca67bab`
release_version	1.54.0-SNAPSHOT~c096994488	1.54.0-SNAPSHOT~ca67bab57c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1759345250	1759345250
ci_job_id	1158264245	1158264245
ci_pipeline_id	78117784	78117784
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-09bnju7s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-09bnju7s 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (2.479 ms) : 2428, 2529
.   : milestone, 2479,
iast (2.222 ms) : 2159, 2286
.   : milestone, 2222,
iast_GLOBAL (2.27 ms) : 2206, 2333
.   : milestone, 2270,
profiling (2.089 ms) : 2036, 2142
.   : milestone, 2089,
tracing (2.03 ms) : 1981, 2080
.   : milestone, 2030,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.73 ms) : 3511, 3949
.   : milestone, 3730,
iast (2.214 ms) : 2151, 2278
.   : milestone, 2214,
iast_GLOBAL (2.262 ms) : 2198, 2326
.   : milestone, 2262,
profiling (2.084 ms) : 2032, 2137
.   : milestone, 2084,
tracing (2.035 ms) : 1986, 2085
.   : milestone, 2035,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.471 ms, 1.494 ms]	-
appsec	2.479 ms [2.428 ms, 2.529 ms]	996.449 µs (67.2%)
iast	2.222 ms [2.159 ms, 2.286 ms]	740.208 µs (49.9%)
iast_GLOBAL	2.27 ms [2.206 ms, 2.333 ms]	787.329 µs (53.1%)
profiling	2.089 ms [2.036 ms, 2.142 ms]	606.993 µs (41.0%)
tracing	2.03 ms [1.981 ms, 2.08 ms]	548.126 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.73 ms [3.511 ms, 3.949 ms]	2.249 ms (151.9%)
iast	2.214 ms [2.151 ms, 2.278 ms]	734.057 µs (49.6%)
iast_GLOBAL	2.262 ms [2.198 ms, 2.326 ms]	781.754 µs (52.8%)
profiling	2.084 ms [2.032 ms, 2.137 ms]	603.853 µs (40.8%)
tracing	2.035 ms [1.986 ms, 2.085 ms]	554.912 µs (37.5%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~ca67bab57c, baseline=1.54.0-SNAPSHOT~c096994488
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.603 s) : 15603000, 15603000
.   : milestone, 15603000,
appsec (14.975 s) : 14975000, 14975000
.   : milestone, 14975000,
iast (18.665 s) : 18665000, 18665000
.   : milestone, 18665000,
iast_GLOBAL (18.113 s) : 18113000, 18113000
.   : milestone, 18113000,
profiling (15.539 s) : 15539000, 15539000
.   : milestone, 15539000,
tracing (15.273 s) : 15273000, 15273000
.   : milestone, 15273000,
section candidate
no_agent (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
appsec (15.107 s) : 15107000, 15107000
.   : milestone, 15107000,
iast (18.664 s) : 18664000, 18664000
.   : milestone, 18664000,
iast_GLOBAL (18.29 s) : 18290000, 18290000
.   : milestone, 18290000,
profiling (15.749 s) : 15749000, 15749000
.   : milestone, 15749000,
tracing (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.603 s [15.603 s, 15.603 s]	-
appsec	14.975 s [14.975 s, 14.975 s]	-628.0 ms (-4.0%)
iast	18.665 s [18.665 s, 18.665 s]	3.062 s (19.6%)
iast_GLOBAL	18.113 s [18.113 s, 18.113 s]	2.51 s (16.1%)
profiling	15.539 s [15.539 s, 15.539 s]	-64.0 ms (-0.4%)
tracing	15.273 s [15.273 s, 15.273 s]	-330.0 ms (-2.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.953 s [14.953 s, 14.953 s]	-
appsec	15.107 s [15.107 s, 15.107 s]	154.0 ms (1.0%)
iast	18.664 s [18.664 s, 18.664 s]	3.711 s (24.8%)
iast_GLOBAL	18.29 s [18.29 s, 18.29 s]	3.337 s (22.3%)
profiling	15.749 s [15.749 s, 15.749 s]	796.0 ms (5.3%)
tracing	14.957 s [14.957 s, 14.957 s]	4.0 ms (0.0%)

PerfectSlayer · 2025-09-22T13:17:41Z

dd-smoke-tests/spring-boot-3.0-native/application/build.gradle

        // quick build mode, enough for smoke test
        buildArgs.add("-Ob")
        buildArgs.add("-J-javaagent:$agentPath")
+        buildArgs.add("-J-Dnet.bytebuddy.safe=false")


Is this still needed after #9569

Yes. I believe the net.bytebuddy.nexus.disabled flag from #9569 relates to the Nexus mechanism specifically (that uses Unsafe), while this PR's flag is the one that resolves the Cannot get defined package using reflection: Use of Unsafe was disabled by system property error.

sarahchen6 mentioned this pull request Sep 18, 2025

Add graalvm25 image DataDog/dd-trace-java-docker-build#119

Merged

sarahchen6 added type: enhancement Enhancements and improvements comp: testing Testing tag: no release notes Changes to exclude from release notes labels Sep 18, 2025

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch 2 times, most recently from 506ec84 to b191c6f Compare September 18, 2025 20:57

PerfectSlayer reviewed Sep 22, 2025

View reviewed changes

sarahchen6 added 6 commits September 22, 2025 14:11

Add graalvm25 image to testing

c563680

Add flag to allow use of unsafe

c550712

Add Graalvm 25 specification to profiling

d647f26

Change arg for Graalvm 25

af76058

Add flag to start jfr recording

be16336

Try removing extra flags

6f9f05d

sarahchen6 force-pushed the sarahchen6/test-graalvm25 branch from 76c6260 to 6f9f05d Compare September 22, 2025 18:12

sarahchen6 added 2 commits September 22, 2025 15:30

Remove flag

bd4ef89

Merge branch 'master' into sarahchen6/test-graalvm25

ca67bab

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add graalvm25 image to testing #9562

Add graalvm25 image to testing #9562

Uh oh!

sarahchen6 commented Sep 18, 2025 •

edited

Loading

Uh oh!

datadog-official bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

pr-commenter bot commented Sep 18, 2025 •

edited

Loading

Uh oh!

PerfectSlayer Sep 22, 2025

Uh oh!

sarahchen6 Sep 22, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Add graalvm25 image to testing #9562

Are you sure you want to change the base?

Add graalvm25 image to testing #9562

Uh oh!

Conversation

sarahchen6 commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-official bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenter bot commented Sep 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer Sep 22, 2025

Choose a reason for hiding this comment

Uh oh!

sarahchen6 Sep 22, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

sarahchen6 commented Sep 18, 2025 •

edited

Loading

datadog-official bot commented Sep 18, 2025 •

edited

Loading

pr-commenter bot commented Sep 18, 2025 •

edited

Loading